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CLAIMS 

1 . An extensible, system-independent, version-interoperable format for transmitting 
a data stream having data set information from a source system to a replica residing on a 
destination system comprising: 

a plurality of standalone headers having discrete identifiers, each of the plurality 
of standalone headers being representative of a plurality of data stream characteristics; 
and 

a data following header that follows, in the data stream, the plurality of standalone 
headers and that indicates that the data set information is following the data following 
header, the data set header including an extended attribute field that associates an ex- 
tended attribute with the data set information. 

2. The format as set forth in claim 1 wherein the plurality of standalone headers each 
include an indication of one of a plurality of specialized header types and at least some of 
the plurality of specialized header types are adapted for carrying directory inode data. 

3. The format as set forth in claim 3 wherein the data stream is adapted to carry 
source file system inode data and source file generation numbers. 

4. The format as set forth in claim 2 wherein one of the specialized header types 
comprises a deleted files type and the directory inode data comprises a list of deleted files 
on the source file system. 

5. The format as set forth in claim 1 wherein the extended attributes include ACLs 
and streams associated with a plurality of operating systems and system architectures. 

6. The format as set forth in claim 1 wherein one of the plurality of standalone head- 
ers comprises an open file/undo header that instructs the destination system to revert to an 
earlier copy of a stored file identified by the open file/undo header. 
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7. The format as set forth in claim 1 wherein the data set information comprises file 
information. 

8. The format as set forth in claim 1 wherein the data set information comprises 
changed files on the source system transmitted for backup on the replica of the destina- 
tion system. 

9. The format as set forth in claim 1 wherein the data following header includes off- 
set and block number information with respect to the data set information that follows the 
data following header. 

10. The format as set forth in claim 1 wherein data following header comprises a 
fixed-length record including (a) a generic part for storing an indication of a data follow- 
ing header type; (b) a non-generic part, adapted to carry predetermined data related to the 
extended attribute and data related to offsets and block numbers for the data set informa- 
tion that follows the data following header; and (c) a space for a bit-code representative 
of a name associated with the extended attribute. 

1 1 . The format as set forth in claim 1 wherein each of the plurality of standalone 
headers comprises a fixed-length record including a generic part for storing an indication 
of one of a plurality of specialized header types, a non-generic part, adapted to carry pre- 
determined data related one of the specialized header types and a space for additional in- 
formation. 

12. The format as set forth in claim 1 wherein the data following header is adapted to 
be positioned within the data stream at predetermined intervals that are up to approxi- 
mately 2 MB of data set information in size. 
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13. The format as set forth in claim 1 wherein the destination system is adapted to 
receive the data following header with the extended attribute and cause the data set in- 
formation associated with the extended attribute to be stored an entry in a hidden perma- 
nent metadirectory with identifiers that are the same as identifiers for the data set infor- 
mation in a file system of the destination system, the entry having the extended attribute 
associated therewith so that retrieval of the entry from the hidden permanent metadirec- 
tory also retrieves the extended attribute. 

14. The format as set forth in claim 13 wherein the destination system also includes a 
hidden purgatory metadirectory in which current data set information from the hidden 
permanent directory is stored during an update of the hidden permanent metadirectory 
with changed data set information, the destination system being further adapted to (a) 
delete the hidden purgatory metadirectory after a complete receipt of all expected 
changed data set information of the hidden permanent metadirectory with the changed 
data set information, and (b) move current data set information stored on the hidden pur- 
gatory directory back to the hidden permanent metadirectory after an incomplete receipt 
of all expected changed data set information. 

15. The format as set forth in claim 14 wherein the destination system is adapted to 
create hidden new metadirectory to store changed data set information for transfer to the 
hidden permanent directory after of the complete receipt of all the expected changed data 
set information. 

16. The format as set forth in claim 1 wherein the source system and the destination 
system are remote with respect to each other and interconnected by a network, and 
wherein the data stream is encapsulated within a networking protocol adapted for trans- 
mission over the network. 

17. A format for transmitting a data stream that includes data set information between 
a source system and a replica stored on the destination system comprising: 
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a data following header appended to a predetermined-sized chunk of data, the data 
following header including a field that identifies extended attributes associated with data 
set information carried in the chunk. 

18. The format as set forth in claim 17 wherein the extended attributes include ACLs 
and streams associated with a plurality of operating systems and system architectures. 

19. The format as set forth in claim 17 wherein the data set information comprises file 
information. 

20. The format as set forth in claim 17 wherein the data set information comprises 
changed files on the source system transmitted for backup on the replica of the destina- 
tion system. 

21 . The format as set forth in claim 17 wherein the data following header includes 
offset and block number information with respect to the data set information that follows 
the data following header. 

22. The format as set forth in claim 17 wherein data following header comprises a 
fixed-length record including (a) a generic part for storing an indication of a data follow- 
ing header type; (b) a non-generic part, adapted to carry predetermined data related to the 
extended attribute and data related to offsets and block numbers for the data set informa- 
tion that follows the data following header; and (c) a space for a bit-code representative 
of a name associated with the extended attribute. 

23. The format as set forth in claim 17 wherein the chunk has a size of up to ap- 
proximately 2 MB of data set information. 

24. The format as set forth in claim 17 wherein the destination system is adapted to 
receive the data following header with the extended attribute and cause the data set in- 
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formation associated with the extended attribute to be stored an entry in a hidden perma- 
nent metadirectory with identifiers that are the same as identifiers for the data set infor- 
mation in a file system of the destination system, the entry having the extended attribute 
associated therewith so that retrieval of the entry from the hidden permanent metadirec- 
tory also retrieves the extended attribute. 

25. The format as set forth in claim 24 wherein the destination system also includes a 
hidden purgatory metadirectory in which current data set information from the hidden 
permanent directory is stored during an update of the hidden permanent metadirectory 
with changed data set information, the destination system being further adapted to (a) 
delete the hidden purgatory metadirectory after a complete receipt of all expected 
changed data set information of the hidden permanent metadirectory with the changed 
data set information, and (b) move current data set information stored on the hidden pur- 
gatory directory back to the hidden permanent metadirectory after an incomplete receipt 
of all expected changed data set information. 

26. The format as set forth in claim 25 wherein the destination system is adapted to 
create hidden new metadirectory to store changed data set information for transfer to the 
hidden permanent directory after of the complete receipt of all the expected changed data 
set information. 

27. A method for storing and retrieving extended attributes associated with a data set 
information comprising: 

storing a current data set information with current extended attributes in a perma- 
nent hidden metadirectory; 

transferring the data set information to a purgatory metadirectory upon receipt of 
a changed data set information; 

storing the received changed data set information in a new metadirectory; and 

upon completion of receipt of all expected changed data set information, transfer- 
ring the received changed data set information from the new metadirectory to the perma- 
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nent metadirectory, the permanent metadirectory thereby being available for retrieval of 
extended attributes associated with the data set information. 

28. The method as set forth in claim 27 further comprising the step of, upon a failure 
to complete receipt of all expected changed data set information, transferring the current 
data set information with the current extended attributes back to the permanent metadi- 
rectory. 

29. The method as set forth in claim 28 wherein the data set information comprises 
files organized in a directory tree structure the same as a file system structure on the des- 
tination system and wherein the extended attributes comprise ACLs and streams associ- 
ated with the files. 

30. The method as set forth in claim 29 further comprising the step of deleting the 
purgatory metadirectory after one of, either (a) the transferring of the changed data set 
information from the new metadirectory to the permanent metadirectory or (b) the trans- 
ferring of the current data set information from the purgatory metadirectory back to the 
permanent metadirectory. 

3 1 . The method as set forth in claim 30 further comprising, upon a request from the 
source to restore data sets from the data set information, scanning the permanent direc- 
tory and retrieving the data sets including retrieving respective of the extended attributes 
associated with the data sets. 

32. The method as set forth in claim 3 1 further comprising the step of providing the 
retrieved data sets' extended attributes in a format for transmission to the source from the 
destination, the format including data following headers each having a field that associ- 
ates the respective of the extended attributes with the retrieved data sets. 
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33. The method as set forth in claim 32 wherein the respective of the extended attrib- 
utes are associated with the data sets based upon NT streams. 

34. The method as set forth in claim 27 wherein the extended attributes are associated 
with the data set information in the permanent metadirectory using NT streams. 

35. The method as set forth in claim 27 further comprising the step of providing the 
data sets' extended attributes in a format for transmission to the destination from the 
source, the format including data following headers each having a field that associates the 
respective of the extended attributes with the retrieved data sets. 

36. A method for ensuring coherency in a data set transmitted from a source system to 
a replica on a destination system comprising the steps of: 

retrieving a first modification time on the source system for the data set; 

opening the data set on the source system and transmitting the data set from the 
source system to the destination; 

after completing transmitting, closing the data set on the source system and re- 
trieving second modification time on the source system; and 

if the second modification time and the first modification time are not the same, 
providing by the source system an instruction to the destination system to revert to an 
earlier stored copy of the data set on the replica. 

37. The method as set forth in claim 36 wherein the step of providing the instruction 
comprises transmitting an undo standalone header in a data stream that includes the data 
set, the standalone header identifying the data set and indicating an undo header type. 
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